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Asserted claims 


Blum 


8.1 


8. The method of simultaneously displaying 
and storing multiple video images, 
comprising the steps of: 


"A system which retrofits to an existing surveillance system and 
cooperates with sensors, video cameras and video monitors of the 
existing surveillance system." Abstract. 

Specifically, as shown in FIG. 15B, there are four image display areas 
on a monitor screen." 1 1 ; 65-56. 

"Several frame grabber/frame storage processing boards are provided, 
each of which digitizes the analog video signals from the video cameras 
and stores the digital data in a solid state buffer memory." 2: 9-13. 


B.2 


receiving video images from a plurality of 
sources; 


Discloses "computerized video switch" that receives video signals from 
cameras. 

FIG. 1, including Computerized Video Switch and accompanying text. 


8.3 


digitizing one or more of the images if not 
already in digital form; 


"Several frame grabber/frame storage processing boards are provided, 
each of which digitizes the analog video signals from the video cameras 
and stores the digital data in a solid state buffer memory." 2: 9-1 3. 

"[The FG/FS board] digitizes the analog video signal generated by the 
cameras 1-8 and stores the digital video image temporarily in a 
hardware FIFO buffer 76." 6: 18-21, 

"The A/D converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76, which 
serves as a buffer." 6: 55-57. 

FIG. 2, including FG/FS #1 , #2 and #N and accompanying text. 
FIG. 4, including A/D Computer (Frame Grabber) and accompanying 
text. 


8.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"Several display boards are provided to display the digitized video data 
on display monitors." Abstract. 

"Further, each display board is connected to one of a plurality of high 
resolution video monitors 28." 3: 58-60. 

"Specifically, as shown in FIG. 15B, there are four image display areas 
on a monitor screen." 11:65-66. 

"Frames Per Camera— Total number of frames per camera that can be 
captured when an alarm occurs. System maximum of 64." 15:32-16: 
2. 

"Display Resolution - The system resolution for (he images presented to 
the operator. Options include 256X240 pixels or 512X480 pixels 
(normal)." 16:3-5. 

"Frame Grab Rate—Interval between image frame grabs. System 
minimum of 500 milliseconds, maximum of 99 seconds. Separately 
programmable for each camera," 16: 12-15. 

FIG. 1, including High Resolution Monitors and accompanying text. 
FIG, 2, including Display #1 -#3 and accompanying text. 





USP 5,625,410 


U.S. Patent No. 5,237,408 
Filing date: 8/2/1991 
Issue date: 8/17/1993 






FIG. 5, including Monitor and accompanying text. 
FIG. 15B and accompanying text. 


8.5 


simultaneously storing the displayed 
images using a second, predetermined 
frame rate and resolution associated with 
each image. 


"The Transputer 80 then removes the digitized image from the FIFO 
buffer 76 and stores it in a large software controlled FIFO buffer located 
in the [Dynamic Random Access Memory] 82." 6: 58-BO. 

"When an event occurs requiring the display of images stored in the 
FG/FE board, the Transputer 50 on the controller board sends a 
message requesting the FG/FS Transputer send the particular image(s) 
for that camera down the video link 38." 7: 7-11, 

"The AID converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76, which 
serves as a buffer." 6: 55-57. 

"Disk Storage Devices (Number and Types) - The storage space the 
operator has for archiving images. Types include fixed disks (various 
sizes) and/or combinations of removable disks." 15:3-6. 

"Frames Per Camera— Total number of frames per camera that can be 
captured when an alarm occurs. System maximum of 64." 15:32-16: 
2, 

"Frame Grab Rate— Interval between image frame grabs. System 
minimum of 500 milliseconds, maximum of 99 seconds. Separately 
programmable for each camera." 16: 12-15. 






FIG. 4, including FIFO Memory 76 and DRAM 82 and accompanying 
text. 

FIG. 5, DRAM 102 and accompanying text. 






12.1 


12. The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"A system which retrofits to an existing surveillance system and 
cooperates with sensors, video cameras and video monitors of the 
existing surveillance system." Abstract. 

"Specifically, as shown in FIG. 15B, there are four image display areas 
on a monitor screen." 11: 65-66. 

"Several frame grabber/frame storage processing boards are provided, 
each of which digitizes the analog video signals from the video cameras 
and stores the digital data in a solid state buffer memory." 2: 9-13. 


12.2 


receiving video images from a plurality of 
sources; 


Discloses "computerized video switch" which receives video signals from 
cameras. 

FIG. 1 and accompanying text. 


12.3 


digitizing one or more of the images if not 
already in digital form; 


"Several frame grabber/frame storage processing boards are provided, 
each of which digitizes the analog video signals from the video cameras 
and stores the digital data in a solid state buffer memory." 2: 9-1 3. 

"[The FG/FS board] digitizes the analog video signal generated by the 
cameras 1-8 and stores the digital video image temporarily in a 
hardware FIFO buffer 76." 6:18-21. 
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"The A/D converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76, which 
serves as a buffer." 6: 55-57. 

FIG. 2, including FG/FS #1 , #2 and #N and accompanying text. 
FIG. 4, including A/D Computer (Frame Grabber) and accompanying 
text. 


12.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first set of temporal and 
spatial parameters associated with each 
image in each window; 


"Several display boards are provided to display the digitized video data 
on display monitors." Abstract. 

"Further, each display board is connected to one of a plurality of high 
resolution video monitors 28." 3: 58-60. 

"Specifically, as shown in FIG. 15B, there are four image display areas 
on a monitor screen." 11: 65-66. 

"Frames Per Camera— Total number of frames per camera that can be 
captured when an alarm occurs. System maximum of 64." 15: 32-16: 
2. 

"Display Resolution - The system resolution for the images presented to 
the operator. Options include 256X240 pixels or 512X480 pixels 
(normal}." 16:3-5. 

"Frame Grab Rate— Interval between image frame grabs. System 
minimum of 500 milliseconds, maximum of 99 seconds. Separately 
programmable for each camera." 16: 12-15. 

FIG. 1, including High Resolution Monitors and accompanying text. 
FIG. 2, including Display #1 -#3 and accompanying text. 
FIG. 5, including Monitor and accompanying text. 
FIG. 15B and accompanying text. 


12.5 


simultaneously storing the displayed 
images using a second set of temporal and 
spatial paramelers associated wilh each 
image. 


"The FIFO buffer in the DRAM contains sufficient memory space for 
staring an entire sequence of images for each camera." 6: 60-63. 

"When an event occurs requiring the display of images stored in the 
FG/FS board, the Transputer 50 on the controller board sends a 
message requesting the FG/FS Transputer send the particular image(s) 
far that camera down the video link 38." 7: 7-1 1 . 

"The A/D converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76, which 
serves as a buffer." 6: 55-57. 

"Disk Storage Devices (Number and Types) - The storage space the 
operator has for archiving images. Types include fixed disks (various 
sizes) and/or combinations of removable disks." 15:3-6. 

"Frames Per Camera— Total number of frames per camera that can be 
captured when an alarm occurs. System maximum of 64." 15:32-16: 
2. 

"Frame Grab Rate— Interval between image frame grabs. System 
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minimum of 500 milliseconds, maximum of 99 seconds. Separately 
programmable for each camera." 16: 12-15. 

FIG. A, including FIFO Memory 76 and DRAM 82 and accompanying 
text. 

FIG. 5, DRAM 102 and accompanying text. 


15.1 


15. A video storage and display system, 
comprising: 


"A system which retrofits to an existing surveillance system and 
cooperates with sensors, video cameras and video monitors of the 
existing surveillance system," Abstract. 

"Specifically, as shown in FIG, 1 5B, there are four image display areas 
on a monitor screen." 11: 65-66. 

"Several frame grabber/frame storage processing boards are provided, 
each of which digitizes the analog video signals from the video cameras 
and stores the digital data in a solid state buffer memory." 2: 9-13. 


15.2 


a plurality of video cameras, each 
outputting a signal representative of a video 
image; 


"This [FG/FS] board digitizes the analog video signal generated by the 
cameras 1-8..." 6: 18-19. 

FIGS. 1, 4 and accompanying text. 


15.3 


means to receive the signals from each 
camera and digitally compress the images; 
and 


Means to receive the signals from each camera and digitally compress 
the images is at least Computerized Video Switch 16, FG/FS #1 , #2 and 
#N, and AID Converter 74. 

"Several frame grabber/frame storage processing boards are provided, 
each of which digitizes the analog video signals from the video cameras 
and stores the digital data in a solid state buffer memory." 2: 9-13. 

"For example, the option modules connected to the FG/FS boards may 
include image data compressors which operate on the digitized images 
to compress the digital image data. The compressed data is then stored 
back in the FG/FS board and placed over the video link, when desired. 
Likewise, the option modules connected to display boards may comprise 
decompressors to decompress the compressed data which is then 
supplied to a monitor. This would result in increased image storage 
capabilities and decreased transmission times." 5:21-31. 

"Uhe FG/FS board] digitizes the analog video signal generated by the 
cameras 1-8 and stores the digital video image temporarily in a 
hardware FIFO buffer 76." 6: 18-21. 

"The A/D converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76, which 
serves as a buffer." 6; 55-57. 

FIG. 1, Computerized Video Switch 16 and accompanying text 
FIG. 2, including FG/FS #1, #2 and #N and accompanying text. 
FIG. 4, including A/D Computer (Frame Grabber) 74 and accompanying 
text. 


15.4 


a computer configured to receive the 
digitally compressed images, the computer 


"Other types of option modules may be used to support data 
transmission. For example, the option modules connected to the FG/FS 
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being interfaced to the following devices: 


boards may include image data compressors which operate on the 
digitized images to compress the digital image data. The compressed 
data is then stored back in the FG/FS board and placed over the video 
link, when desired. . . . Compressed images could also be 
communicated out of the DVSS 10 via a modem 201 for decompression 
in a remote system." 5:18-31, 

Discloses that video output of the FIFO memory "is connected to a 
Transputer processor 80." 6: 36-37. 

"The Transputer then removes the digitized image from the FIFO buffer 
and stores it in a large software controlled FIFO buffer located in the 
DRAM 82." 6: 58-60. 

"Bubble 5 represents software for communication data preparation 
including software for compression and decompression of data for 
interface with fax machines and modems." 9:45-48. 

FIG. 4, including Transputer Processor 80 and accompanying text. 


15.5 


a display screen, 


"Several display boards are provided to display the digitized video data 
on display monitors." Abstract. 

"Further, each display board is connected to one of a plurality of high 
resolution video monitors 28." 3: 58-60. 

"Specifically, as shown in FIG. 15B, there are four image display areas 
on a monitor screen " 1 1 * 65-66 

FIG. 1, including High Resolution Monitors and accompanying text. 
FIG. 2, including Display #1 - #3 and accompanying text. 
FIG. 5, including Monitor and accompanying text. 
FIG. 15B and accompanying text. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal- 
state image scene associated with at 
least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 
derived command, and 


Means to receive externally derived operator commands is at least Video 
Switch Keyboard 26 and Digital Video Surveillance System. 

Means for sensing a deviation from the normal-state image scene 
associated with at least one of the video cameras is at least MD Modules 
42{1)-42{N) and CD Modules 44(1)-44(N). 

"The video switch keyboard allows an operator to manually route a video 
signal from any camera to a live video monitor." 3: 37-39. 

"...motion detection modules (MD) may be connected to the FG/FS 
boards respectively to analyze Ihe digitized video data for any motion or 
change in a field of view of any camera associated with the motion 
detection module." 5: 3-7. 

"The CD modules identify areas of change in images displayed as a 
result of an external sensor alarm." 5: 14-16. 

"The [Digital Video Surveillance System] maintains a user defined table 
of command strings and associated actions." 8: 48-50. 
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FIG. 1, including Digital Video Surveillance System and Video Switch 
Keyboard 26 and accompanying text. 

FIG. 2, including MD Modules 42{1)-42(N) and CD Modules 44(1)-44(N) 
and accompanying text. 


15.7 


a high-capacity storage medium, and 
programmed to perform the following 
functions: 


"The FIFO buffer in the DRAM contains sufficient memory space for 
storing an entire sequence of images for each camera," 6: 60-63. 

"When an event occurs requiring the display of images stored in the 
FG/FS board, the Transputer 50 on the controller board sends a 
message requesting the FG/FS Transputer send the particular irnage(1) 
for that camera down the video link 38." 7: 7-11. 

"The A/D converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76, which 
serves as a buffer," 6: 55-57. 

"The controller board communicalions with disk I/O devices via a Small 
Computer System Interface (SCSI) disk controller 43. This provides for 
access to devices that conform to the SCSI protocol, hard disk storage 
and retrieval, file management, copying and deleting for disk stored files, 
activity log maintenance, etc." 8:55-60. 

"Disk Storage Devices (Number and Types) - The storage space the 
operator has for archiving images. Types include fixed disks (various 
sizes) and/or combinations of removable disks." 15:3-6. 

FIG. 4, including FIFO Memory 76 and DRAM 82 and accompanying 
text. 

FIG. 5, including DRAM 102 and accompanying text. 


15.8 


display the digitally compressed 
images from the cameras in different 
windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


"Several display boards are provided to display the digitized video dala 
on display monitors." Abstract. 

"Further, each display board is connected to one of a plurality of high 
resolution video monitors 28." 3: 58-60. 

"Specifically, as shown in FIG. 15B, there are four image display areas 

FIG. 1, including High Resolution Monitors and accompanying text. 
FIG. 2, including Display #1 -#3 and accompanying text. 
FIG. 5, including Monitor and accompanying text. 
FIG. 15B and accompanying text. 


15.9 


vary the dimensions and the rate at 
which a particular image is updated in 
its window in accordance with one of 
the externally derived commands, 


The CHANGE button causes the active display window to be enlarged 
to the full size of the display." 13: 32-33. 

"Frame Grab Rate— Interval between image frame grabs. System 
minimum of 500 milliseconds, maximum of 99 seconds. Separately 
programmable for each camera." 16: 12-15. 


15.10 


store the digitally compressed images 
in the high-capacity storage medium, 
and 


"The FIFO buffer in the DRAM contains sufficient memory space for 
staring an entire sequence of images for each camera." 6: 60-63. 

"When an event occurs requiring the display of images stored in the 
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FG/FS board, the Transputer 50 on the controller board sends a 
message requesting the FG/FS Transputer send the particular image(s) 
for that camera down the video link 3B." 7: 7-1 1 . 

"The A/D converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76 which 
serves as a buffer." 6: 55-57. 

FIG. 4, including FIFO Memory 76 and DRAM 82 and accompanying 
text. 

FIG, 5, including DRAM 102 and accompanyinq text. 


15.11 


vary the dimensions and the rate at 
which a particular image is stored in 
accordance with one of the externally 
derived commands. 


"The FIFO buffer in the DRAM contains sufficient memory space for 
storing an entire sequence of images for each camera." 6: 60-63. 

"When an event occurs requiring the display of images stored in the 
FG/FS board, the Transputer 50 on the controller board sends a 
message requesting the FG/FS Transputer send the particular image(s) 
for that camera down the video link 38." 7: 7-11. 

"The A/D converter digitizes the analog video signal and stores the 
digital information in a hardware controlled FIFO memory 76, which 
serves as a buffer." 6: 55-57. 

"Frame Grab Rate— Interval between image frame grabs. System 
minimum of 500 milliseconds, maximum of 99 seconds. Separately 
programmable for each camera." 16: 12-15. 

FIG. 4, including FIFO Memory 76 and DRAM 82 and accompanying 
text. 

FIG. 5, including DRAM 102 and accompanying text. 



7 



EXHIBIT 2 



# 


USP 5,625,410 


U.S. Patent No. 4,650,929 
Filing date: 2/28/1985 
Issue date: 3/17/1987 




Asserted claims 


Boerger 


8.1 


8. The melhod of simultaneously displaying 
and storing multiple video images, 
comprising the steps of: 


"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations... a subscriber station at each participant location, each 
particular subscriber station including,., video reception signal means for 
receiving and displaying a video reception signal at said particular 
stalion...video storage means for storing video signals corresponding to 
said video source signals received from participating subscriber 
stations." Claim 1. 


8.2 


receiving video images from a plurality of 
sources; 


"The video source signals 41 coming from camera 26 are supplied to an 
analog-to-digital converter 9 wherefrom they pass, through an 
intermediate or first-in-first-out buffer storage (FiFo) 10, if provided, to a 
large piciure storage 5." 7; 29-33. 

"A central station is connected to all of the participant terminals and 
includes means for receiving source signals from and transmitting sink or 
received signals to all the participant terminals." 2: 39-42, 

FIG. 1, includinq Camera 26 and accompanyinq text. 


8.3 


digitizing one or more of the images if not 
already in digital form; 


"The video source signals 41 coming from camera 26 are supplied to an 
analog-to-digital converter 9 wherefrom they pass, through an 
intermediate or first-in-first-out buffer storage (FiFo) 10, if provided, to a 
large picture storage 5." 7: 29-33, 

"System of claim 1 wherein said central station includes analog-to-digital 
converter means." Claim 3. 


8.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"FIGS. 8 r 9 and 10 show a selection of some examples of split-screen 
combinations of large pictures 46(u), 46(v) and 46(w) and small pictures 
of47(x),47(y),and47(z)." 8:62-64, 

"At every location, also the participant's own image can be displayed as 
a complete or full screen picture or a mixture or split screen picture 
arrangement on the individual monitors." 4: 6-9, 

"The video source signals 41 coming from camera 26 are supplied la an 
analog-to-digital converter 9 wherefrom they pass, through an 
intermediate or first-in-first-out buffer storage (FiFo) 1 0, if provided, to a 
large picture storage 5." 7: 29-33. 

"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations... a subscriber station at each participant location, each 
particular subscriber station including.,, video reception signal means for 
receiving and displaying a video reception signal at said particular 
station-displaying at said particular station either an individually 
selected full screen picture or an individually combined split screen 
picture of a plurality of pictures which are correspondingly smaller than 
full said screen picture. " Claim 1, 

FIG. 1 , including Monitor 27 and accompanying text. 

FIG. 4 and accompanyinq text 
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a.5 


simultaneously storing the displayed 
images using a second, predetermined 
frame rate and resolution associated with 
each image. 


"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations.,, a central station comprising:.,.video storage means for 
staring video signals corresponding to said video source signals 
received from participating subscriber stations, each said video signal to 
be stored representing either a full screen picture or both a large picture 
and a small picture." Claim 1. 

"System of claim 1 wherein said video storage means are provided for 
storing video source signals corresponding to said large and small 
pictures and have a storage capacity for such a large piclure and for a 
plurality of such small pictures." Claim 5. 

"According to the invention central stations can be equipped with any 
number of picture storage units and multiplexers but at least with a 
number needed for a single videoconference." 3: 43-47. 

"This equipment is assigned to the participating locations 25 always for 
the duration of video conference and it substantially comprises large 
picture storages 5 and small picture storages 6." 7: 12-15. 

Parallel to large picture storage 5 a coarsened or small picture, i.e. one 
whose number of picture elements is two-dimensionally reduced (width 
and height).. .and supplied to a small picture storage 6." 7: 37-43. 

FIG, 1 , including Large Picture Storage 5 and accompanying text. 
FIG. 2, including Small Picture Storaqe 6 and accompanyinq text. 


12.1 


12. The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations.,, 3 subscriber station at each participant location each 
particular subscriber station including... video reception signal means for 
receiving and displaying a video reception signal at said particular 
station.. .video storage means for storing video signals corresponding to 
said video source signals received from participating subscriber 
stations." Claim 1. 


12.2 


receiving video images from a plurality of 
sources; 


"The video source signals 41 coming from camera 26 are supplied to an 
analog-to-digita! converter 9 wherefrom they pass, through an 
intermediate or first-in-first-out buffer storage (FiFo) 10, if provided, to a 
large picture storage 5." 7: 29-33. 

"A central station is connected to all of the participant terminals and 
includes means for receiving source signals from and transmitting sink or 
received signals to all the participant terminals." 2: 39-42. 

FIG. 1, including Camera 26 and accompanyinq text. 


12.3 


digitizing one or more of the images if not 
already in digital form; 


"The video source signals 41 coming from camera 26 are supplied to an 
analog-to-digital converter 9 wherefrom they pass through an 
intermediate or first-in-first-out buffer storage (FiFo) 10, if provided, to a 
large picture storage 5." 7: 29-33. 

"System of claim 1 wherein said central station includes analog-to-digital 
converter means." Claim 3. 


12.4 


displaying at ieast certain of the digitized 


"FIGS. 8, 9 and 10 show a selection of some examples of split-screen 
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images In separate windows on a display 
device, using a first set of temporal and 
spatial parameters associated with each 
image in each window; 


combinations of large pictures 46(u) t 4G(v) and 46(w) and small pictures 
of47(x),47{y),and47(z)." 8:62-64. 

"At every location, also the participant's own image can be displayed as 
a complete or full screen picture or a mixture or split screen picture 
arrangement on the individual monitors." 4: 6-9, 

"The video source signals 41 coming from camera 26 are supplied to an 
analog-to-digital converter 9 wherefrom they pass, through an 
intermediate or first-in-first-out buffer storage (FiFo) 10, if provided, to a 
large picture storage 5." 7: 29-33. 

"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations... a subscriber station at each participant location, each 
particular subscriber station including... video reception signal means for 
receiving and displaying a video reception signal at said particular 
stalion...displaying at said particular station either an individually 
selected fulJ screen picture or an individually combined split screen 
picture of a plurality of pictures which are correspondingly smaller than 
full said screen picture. " Claim 1 . 

FIG. 1, including Monitor 27 and accompanying text, 
FIG. 4 and accompanying text. 


12.5 


simultaneously storing the displayed 
images using a second set of temporal and 
spatial parameters associated with each 
image. 


"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations... a central station comprising:... video storage means for 
storing video signals corresponding to said video source signals 
received from participating subscriber stations, each said video signal to 
be stored representing either a full screen picture or both a large picture 
and a small picture." Claim 1. 

"System of claim 1 wherein said video slorage means are provided for 
storing video source signals corresponding to said large and small 
pictures and have a storage capacity for such a large picture and for a 
plurality of such small pictures." Claim 5. 

"According to the invention central stations can be equipped with any 
number of picture storage units and multiplexers but at least with a 
number needed for a single videoconference." 3: 43-47. 

"This equipment is assigned to the participating locations 25 always for 
the duration of video conference and it substantially comprises large 
picture storages 5 and small picture storages 6." 7: 12-15. 

"Parallel to large picture storage 5 a coarsened or small picture, i.e. one 
whose number of picture elements is two-dimensionally reduced (width 
and height)., .and supplied to a small picture slorage 6." 7' 37-43 

FIG. 1, including Large Picture Storage 5 and accompanying text. 
FIG. 2, includinq Small Picture Storaqe 6 and accompanyinq text. 


15.1 


15. A video storage and display system, 
comprising: 


"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
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locations... a subscriber station at each participant location, each 
particular subscriber station including... video reception signal means for 
receiving and displaying a video reception signal at said particular 
slalion...video storage means for storing video signals corresponding to 
said video source signals received from participating subscriber 
stations." Claim 1. 


15.2 


a plurality of video cameras, each 
outpulling a signal representative of a video 
image; 


"The video source signals 41 coming from camera 26 are supplied to an 
analog-to-digilal converter 9 wherefrom they pass, through an 
intermediate or first-in-first-out buffer storage (FiFo) 10, if provided, to a 
large picture storage 5." 7: 29-33. 

"A central station is connected to all of the participant terminals and 
includes means for receiving source signals from and transmitting sink or 
received signals to all the participant terminals." 2: 39-42. 

"It is important that every participating location needs, of course, a 
camera, a single monitor, and the usual microphone loudspeaker 
means." 2: 61-64. 

FIG. 1, including Camera 26 and accompanyinq text. 


15.3 


means to receive the signals from each 
camera and digitally compress the images; 
and 


Means to receive externally derived operator commands is analog-to- 
digital converters. 

"The video source signals 41 coming from camera 26 are supplied to an 
analog-to-drgilal converter 9 wherefrom they pass, through an 
intermediate or first-in-first-out buffer storage (FiFo) 10, if provided, to a 
large picture storage 5." 7: 29-33. 

"System of claim 1 wherein said central station includes analog-to-dfgital 
converter means." Claim 3. 


15.4 


a computer configured to receive the 
digitally compressed images, the computer 
being interfaced to the following devices: 


In a video control processor 16, a standard program is stored according 
to which mixed or split screen picture of the individual large 
pictures. ..and/or small picture.. .are combined to the size of a full or 
complete screen picture 45 (FIG. 8)." 


15.5 


a display screen, 


FIG. 1, including Monitor 27 and accompanying text. 
FIG. 4 and accompanyinq text. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal- 
state image scene associaled with at 
least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 
derived command, and 


Means to receive externally derived operator commands is "programmed 
processor" that receives control signals from participant terminals. 

"Accordingly, an object of the present invention is to provide a 
communication system for performing or holding videoconferences 
between a plurality of participants who are present at different participant 
locations, which comprises... control means which can be manipulated 
to initiate communication with other participants and to control the 
images displayed. " 

A central station is connected to all of the participant terminals. ..the 
central station having a programmed processor for receiving control 
signals from the participant terminals to control the display assembly and 
split screen of large and small or coarse pictures at the participant 
terminals individually." 2: 39-50. 


15.7 


a high-capacity storage medium, and 


"Communication system for performing a video conference among a 
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programmed to perform the following 
functions: 


plurality of participants who are present at a plurality of independent 
locations... a central station comprising:. ..video storage means for 
storing video signals corresponding to said video source signals 
received from participating subscriber stations, each said video signal to 
be stored representing either a full screen picture or both a large picture 
and a small picture." Claim 1. 

"System of claim 1 wherein said video storage means are provided for 
storing video source signals corresponding lo said large and small 
pictures and have a storage capacity for such a large picture and for a 
plurality of such small pictures." Claim 5. 

"According to the invention central stations can be equipped with any 
number of picture slorage units and multiplexers but at least with a 
number needed for a single videoconference." 3: 43-47. 

"This equipment is assigned to the participating locations 25 always for 
the duration of video conference and it substantially comprises large 
picture storages 5 and small picture storages 6." 7: 12-15. 

"Parallel to large picture storage 5 a coarsened or small picture, i.e. one 
whose number of picture elements is two-dimensionally reduced (width 
and height).. .and supplied to a small picture storage 6." 7: 37-43. 

FIG. 1, including Large Picture Storage 5 and accompanying text. 
FIG. 2, including Small Picture Storaqe 6 and accompanying text. 


15.8 


display the digitally compressed 
images from the cameras in different 
windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


"FIGS. 8, 9 and 10 show a selection of some examples of split-screen 
combinations of large pictures 46(u), 46(v) and 46(w) and small pictures 
of47(x),47(y),and47(z)." 8:62-64. 

"At every location, also the participant's own image can be displayed as 
a complete or full screen picture or a mixture or split screen picture 
arrangement on the individual monitors," 4: 6-9. 

"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations... a subscriber station at each participant location, each 
particular subscriber station including... video reception signal means for 
receiving and displaying a video reception signal at said particular 
station...displaying at said particular station either an individually 
selected full screen picture or an individually combined split screen 
picture of a plurality of pictures which are correspondingly smaller than 
full said screen picture. " Claim 1. 

FIG. 1, including Monitor 27 and accompanying text. 
FIG. 4 and accompanying text. 


15,9 


vary the dimensions and the rate at 
which a particular image Is updated in 
its window in accordance with one of 
the externally derived commands, 


"A central station is connected to all of the participant terminals.. .the 
central station having a programmed processor for receiving control 
signals from the participant terminals to control the display assembly and 
split screen of large and small or coarse pictures at the participant 
terminals individually." 2: 39-50. 


15.10 


store the digitally compressed images 
in the high-capacity storaqe medium, 


"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
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and 


iocations... a central station comprising;. ..video storage means for 
staring video signals corresponding to said video source signals 
received from participating subscriber stations, each said video signal to 
be stored representing either a full screen picture or both a large picture 
and a small picture." Claim 1. 

"System of claim 1 wherein said video storage means are provided for 
storing video source signals corresponding to said large and small 
pictures and have a storage capacity for such a large picture and for a 
plurality of such small pictures." Claim 5. 

"According to the invention central stations can be equipped with any 
number of picture storage units and multiplexers but at least with a 
number needed for a single videoconference." 3: 43-47. 

"This equipment is assigned to the participating locations 25 always for 
the duration of video conference and it substantially comprises large 
picture storages 5 and small picture storages 6." 7: 12-15. 

"Parallel to large picture storage 5 a coarsened or small picture, i.e. one 
whose number of picture elements is two-dimension ally reduced (width 
and height).. .and supplied to a small picture storage 6." 7: 37-43. 

FIG. 1, including Large Picture Storage 5 and accompanying text. 
FIG. 2, including Small Picture Storaqe 6 and accompanying text. 


15.11 


vary the dimensions and the rate at 
which a particular image is stored in 
accordance with one of the externally 
derived commands. 


"Communication system for performing a video conference among a 
plurality of participants who are present at a plurality of independent 
locations, ., a central station comprising:. ..video storage means for 
storing video signals corresponding to said video source signals 
received from participating subscriber stations, each said video signal to 
be stored representing either a full screen picture or both a large picture 
and a small picture." Claim 1. 

"System of claim 1 wherein said video storage means are provided for 
storing video source signals corresponding to said large and small 
pictures and have a storage capacity for such a large picture and for a 
plurality of such small pictures." Claim 5. 

"According to the invention central stations can be equipped with any 
number of picture storage units and multiplexers but at least with a 
number needed for a single videoconference." 3: 43-47. 

"This equipment is assigned to the participating locations 25 always for 
the duration of video conference and it substantially comprises large 
picture storages 5 and small picture storages 6." 7: 12-15. 

"Parallel to large picture storage 5 a coarsened or small picture, i.e. one 

and height)...and supplied to a small picture storage 6." 7: 37-43. 

"A central station is connected to all of the participant terminals. ..the 
central station having a programmed processor for receiving control 
signals from the participant terminals to control the display assembly and 
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split screen of large and small or coarse pictures at the participant 
terminals individually." 2: 39-50. 

FIG. 1, including Large Picture Storage 5 and accompanying text. 
FIG. 2, including Small Picture Storage 6 and accompanying text. 
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Asserted claims 


Kannes 


8.1 


8. The method of simultaneously displaying 
and storing multiple video images, 
comprising the steps of: 


"The system includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

"FIG. 4A is a perspective view of an embodiment of the inventive remote 
module which includes a video monitor screen with six regions on the 
screen inlended for displaying six different images comprising a 
composite video signal." 3: 59-63. 

All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-38. 

FIG. 4A, 4B and accompanying text. 


B.2 


receiving video images from a plurality of 
sources; 


"The video signals that are output by cameras 21-24 are supplied to the 
control module on cable 40." 4: 54-56. 

"The voice sensitive switching means will swap the component video 
signals of the composite signal between different regions on the PIP 
monitor's screen." 6: 15-18, 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-3B.. 

FIG. 2 and accompanyinq text. 


8.3 


digitizing one or more of the images if not 
already in digital form; 


The other video signals received at the inputs of switching unit 118 are 
supplied from unit 118 to video signal compression unit 11 9... Unit 119 
generates a composite video signal by compressing the video signals 
that it receives." 9: 58-64. 

FIG. 5, including Compression Unit 119 and accompanyinq text. 


8.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"The system includes a monilor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen. 1 ' Abstract. 

Discloses various embodiments involving a principal video image in 
"large picture region" of monitor and several secondary images in "small 
picture regions." FIG. 4A, FIG. 4B. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62 and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-38. 

"The video and signals to be displayed on the monitors and output by 
the loudspeakers are supplied from cable 40 through cable 30." 4: 37- 
39 

FIG. 5, including Monitors 11, 12, 13, 64a, 65a, 137 and 139 and 
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accompanyinq text. 


8.5 


simultaneously storing the displayed 
images using a second, predetermined 
frame rate and resolution associated with 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio conference record." Abstract. 




each image. 


"The recording unit may include one or more video cassette recorders 
("VCRs")..."3:17-19. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-38. 

"The other inputs of SW-1 are connected... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors." 11:19-26. 

FIG. 2 and accompanying text. 

FIG. 5, including Playback Records 64-66 and Storage Unit 67 and 
accompanyinq text. 


12,1 


1 2. The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"The system includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

"FIG. 4A is a perspective view of an embodiment of the inventive remote 
module which includes a video monitor screen with six regions on the 
screen intended for displaying six different images comprising a 
composite video signal." 3: 59-63. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66," 6: 35-38. 

FIG. 4A, 4B and accompanyinq text. 


12.2 


receiving video images from a plurality of 
sources; 


"The video signals that are output by cameras 21-24 are supplied to the 
control module on cable 40." 4: 54-56. 

"The voice sensitive switching means will swap the component video 
signals of the composite signal between different regions on the PIP 
monitor's screen." 6: 15-18. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-3B.. 

FIG. 2 and accompanying text. 


12,3 


digitizing one or more of the images if not 
already in digital form; 


"The other video signals received at the inputs of switching unit 11 B are 
supplied from unit 118 to video signal compression unit 11 9.. .Unit 119 
generates a composite video signal by compressing the video signals 
that it receives." 9: 58-64. 

FIG. 5, including Compression Unit 119 and accompanyinq text. 


12.4 


displaying at least certain of the diqitized 


"!n FIG. 4A, the "principal" video image is displayed on the "large 
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images in separate windows on a display 
device, using a first set of temporal and 
spatial parameters associated with each 
image in each window; 


picture" region 200 at the upper left of monitor 210's screen. Portion 200 
may cover approximately 80% of the total area of monitor 21 0's screen. 
Each of the other video camera images and the prompt.occupies one of 
"small picture" regions..." S: 28-33. 

"The system includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

Discloses various embodiments involving a principal video image in 
"large picture region" of monitor and several secondary images in "small 
picture regions." FIG. 4A, FIG. 4B. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61 , 62 and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-38. 

"The video and signals to be displayed on the monitors and output by 
the loudspeakers are supplied from cable 40 through cable 30." 4: 37- 
39. 

FIG. 5, including Monitors 11, 12, 13, 64a, 65a, 137 and 139 and 

accompanying text. 

FIG. 4A and accompanyinq text. 


12.5 


simultaneously storing the displayed 
images using a second set of temporal and 
spatial parameters associated with each 
image. 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio conference record." Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3:17-19. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-38. 

"The other inputs of SW-1 are connected... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors." 11: 19-26. 

FIG. 2 and accompanying text. 

FIG. 5, including Playback Records 64-66 and Storage Unit 67 and 
accompanyinq text. 


15.1 


15. A video storage and display system, 
comprising: 


"The system includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

"FIG. 4A is a perspective view of an embodiment of the inventive remote 
module which includes a video monitor screen with six regions on the 
screen intended for displaying six different images comprising a 
composite video signal," 3: 59-63. 
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Ail or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-38. 


15.2 


a plurality of video cameras, each 
oulputting a signal representative of a video 
image; 


"Each of video cameras 21 , 22, 23, and 24 may be aimed at one of the 
local conferees... The video signals that are output by cameras 21-24 
are supplied to the control module on cable 40." 4: 52-56. 

FIG. 1. 


15.3 


means to receive the signals from each 
camera and digitally compress the images; 
and 


Means to receive the signals from each camera and digitally compress 
the images is Video Compression Unit 119. 

"The other video signals received at the inputs of switching unit 118 are 
supplied from unit 118 to video signal compression unit 119.. .Unit 119 
generates a composite video signal by compressing the video signals 
that it receives." 9: 58-64. 

FIG. 5, including Compression Unit 1 19 and accompanying text. 


15.4 


a computer configured to receive the 
digitally compressed images, the computer 
being interfaced to the following devices* 


"The control module includes a computer programmed to control the 
other system components, and may also include the recording unit.... 
The programmed computer may use the active microphone signal to 
generate control signals for causing the video image corresponding to 
the active microphone to be displayed in the large picture area of a 
"picture in picture" monitor." 3: 15-28. 

FIGS. 5-6, includinq Computer 68 and accompanying text. 


15.5 


a display screen, 


I hat single monitor (sometimes referred to herein as a PIP monitor) 
displays a composite video image representing the output of a number of 
video cameras..." 8: 2-4. 

FIG. 5, including Monitors 11, 12, 13, 64a, 65a, 137 and 139 and 
accompanying text. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal- 
stale image scene associated with at 
least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 
derived command, and 


Means to receive externally derived operator commands is control 
console. 

Means for sensing a deviation from the normal-state image scene 
associated with at least one of the video cameras is "voice sensitive" 
switching means. 

"Control console may include controls such as audio volume controls, or 
controls for switching the assignments of the video signals between 
different remote module monitors (or between different PIP regions of a 
single remote module monitor)." 5: 20-24. 

"An active, voice sensitive switching means selects a video signal from 
any one of cameras 21-24 for display as "principal" image on principal 
monitor 15. The voice sensitive switching means continually updates the 
principal video signal selection." 5: 35-40. 

"...and major components of the system's control module (which is 
operated by technician 6)." 4: 16-18. 
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FIG. 1, including Console 25 and accompanying text. 

FIG. 2, including Console 19 and Technician 6 and accompanying text. 


15.7 


a high-capacity storage medium, and 
programmed to perform the following 
functions: 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio conference record." Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3: 17-19. 

"All or some of the video signals arriving at the control module may he 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 6S." 6: 35-38. 

"The other inputs of SW-1 are connected... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors," 11:19-26. 

FIG. 2 and accompanying text. 

FIG. 5, including Playback Records 64-66 and Storage Unit 67 and 
accompanying text. 


15.8 


display the digitally compressed 
images from the cameras in different 
windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


"The system includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

Discloses various embodiments involving a principal video image in 
large picture region" of monitor and several secondary images in "small 
picture regions." FIG. 4A, FIG. 4B. 

the loudspeakers are supplied from cable 40 through cable 30/4: 37- 
39. 

FIG. 5, including Monitors 11, 12, 13, 64a, 65a, 137 and 139 and 
accompanying text. 


15.9 


vary the dimensions and the rate at 
which a particular image is updated in 
its window in accordance with one of 
(he externally derived commands, 


Discloses "voice sensitive video switching means" that "may be 
employed to select a "principal" image for display on the large picture 
region of a video monitor's screen" and thereby altering the image's 
dimensions. B: 54-59. 

"The system includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

in "large picture region" of monitor and several secondary images in 
"small picture regions." FIG. 4A, FIG. 4B. 

FIG. 5, including Monitors 11,12, 13, 64a, 65a, 137 and 139 and 
accompanying text. 


15.10 


store the digitally compressed images 


"The system preferably also includes a recording unit for producing a 
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in the high-capacity storage medium, 
and 


permanent, combined video and audio conference record." Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..."3:17-19. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-38. 

"The other inputs of SW-1 are connected... to the output of video signal 
slorage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors." 11: 19-26. 

FIG. 2 and accompanying text. 

FIG. 5, including Playback Records 64-66 and Storage Unit 67 and 
accompanyinq text. 


15.11 


vary the dimensions and the rate at 
which a particular image is stared in 
accordance with one of the externally 
derived commands. 


"The syslem preferably also includes a recording unit for producing a 
permanent, combined video and audio conference record," Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3:17-19. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 35-3S. 

"The other inputs of SW-1 are connecled... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors.™ 11: 19-26. 

FIG. 2 and accompanying text. 

FIG. 5, including Playback Records 64-66 and Storage Unit 67 and 
accompanyinq text. 
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Asserted claims 


Kannes 


8.1 


8. The method of simultaneously displaying 
and storing multiple video images, 
comprising the steps of: 


"The system also includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording unils 64, 65, and 66." 6: 5B-61. 

FIG. 4A, 4B and accompanyinq text. 


8.2 


receiving video images from a plurality of 
sources; 


'The video signals that are output by cameras 21-24 are supplied to the 
control module on cable 40." 5: 10-12. 

"The voice sensitive switching means will swap the component video 
signals of the composite signal between different regions on the PIP 
monitor's screen." 6: 41-44. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording unils 64, 65, and 66." 6: 5B-61. 

FIG. 2 and accompanyinq text. 


8.3 


digitizing one or more of the images if not 
already in digital form; 


"The digitized video signals from circuits 400-409 are also supplied to 
video processors for extraction of digital chroma and luminance data." 
17: 55-57. 

"In the FIG. 9 embodiment, circuit 220 receives ten video inputs. The 
first nine inputs are received at buffer amplifier/digitizer 400, buffer 
amplifier/digitizer 408, and seven buffer amplifier/digitizer circuits 401- 
407 (not shown in FIG. 9) identical to circuits 400 and 408." 17: 22-27. 

"The buffered output of each of the first unit gain amplifiers is digitized by 
an A-lo-D converter within each of circuits 400-409," 17: 41-43. 

FIG. 9, including A/D Converter 400 and 408 and accompanyinq text. 


S.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"The system also includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

Discloses various embodiments involving a principal video image 
displayed in "large picture region" of monitor and several secondary 
images displayed in "small picture regions." FIG. 4A, FIG. 4B. 

"The video and signals to be displayed on the monitors and output by 
the loudspeakers are supplied from cable 40 through cable 30," 4: 61- 
63. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62 and 63 and recorded by video 
recording units 64, 65, and 66." 6: 58-61. 
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FIG. 5, including Monitors and accompanying text. 
FIG. 7, including Monitors and accompanying text. 


B.5 


simultaneously storing the displayed 
images using a second, predetermined 
frame rate and resolution associated with 
each image. 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio record of a conference." 
Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3: 35-37. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6; 5B-61. 

"The other inputs of SW-1 are connected... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the iocal and 
remote module monitors." 11:32-39. 

FIG. 2 and accompanying text. 

FIGS. 5 and 7, including Playback Record 64-66 and Storage Unit 67 
and accompanyinq text. 


12.1 


12. The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"The system also includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3: 35-37. 

FIG. 4A, 4B and accompanying text. 


12.2 


receiving video images from a plurality of 
sources; 


"The video signals that are output by cameras 21-24 are supplied to the 
control module on cable 40." 5: 10-12. 

"The voice sensitive switching means will swap the component video 
signals of the composite signal between different regions on the PIP 
monitor's screen." 6: 41-44. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 58-61. 

FIG. 2 and accompanying text. 


12.3 


digitizing one or more of Ihe images if not 
already in digital form; 


"The digitized video signals from circuits 400-409 are also supplied to 
video processors for extraction of digital chroma and luminance data " 
17: 55-57. 

"In the FIG, 9 embodiment, circuit 220 receives ten video inputs. The 
first nine inputs are received at buffer amplifier/digitizer 400, buffer 
amplifier/digitizer 408, and seven buffer amplifier/digitizer circuits 401- 
407 (not shown in FIG. 9) identical to circuits 400 and 40B." 17: 22-27. 

"The buffered output of each of the first unit gain amplifiers is digitized by 
an A-to-D converter within each of circuits 400-409." 17: 41-43 
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FIG, 9, including A/D Converter 400 and 408 and accompanying text. 


12.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first set of temporal and 
spatial parameters associated with each 
image in each window; 


"In FIG. 4A, the "principal" video image is displayed on the "large 
picture" region 200 atlhe upper left of monitor 210's screen. Portion 200 
may cover approximately 80% of the total area of monitor 210's screen. 
Each of the other video camera images and the prompt occupies one of 
"small picture" regions..." 8: 54-61. 

"The system also includes a monitor for each conferee, which displays a 
composite video signai including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

Discloses various embodiments involving a principal video image 
displayed in "large picture region" of monitor and several secondary 
images displayed in "small picture regions." FIG. 4A, FIG. 4B. 

"The video and signals to be displayed on the monitors and output by 
the loudspeakers are supplied from cable 40 through cable 30." 4: 61- 
63. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62 and 63 and recorded by video 
recording units 64, 65, and 66." 6: 58-61 

FIG. 5, including Monilors and accompanying text. 
FIG. 7, includinq Monilors and accompanyinq text. 


12.5 


simultaneously storing the displayed 
images using a second set of temporal and 
spatial parameters associated with each 
image. 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio record of a conference." 
Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3: 35-37. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 58-61. 

"The other inputs of SW-1 are connected... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors." 11: 32-39. 

FIG. 2 and accompanying text. 

FIGS, 5 and 7, including Playback Record 64-66 and Storage Unit 67 
and accompanying text. 


15.1 


15, A video storage and display system, 
comprising: 


"The system also includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3: 35-37. 
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15.2 


a plurality of video cameras, each 
outputting a signal representative of a video 
image; 


"Each of video cameras 21, 22, 23, and 24 may be aimed at one of the 
local conferees... The video signals that are output by cameras 21-24 
are supplied to the control module on cable 40." 5: 8-12. 

FIG. 1 and accompanyinq text. 


15.3 


means to receive the signals from each 
camera and digitally compress the images; 
and 


Means to receive the signals from each camera and digitally compress 
the images is A/D Converters 400 and 408 and control module on cable 
40. 

"The video signals that are output by cameras 21-24 are supplied to the 
control module on cable 40." 5: 10-12. 

"The digitized video signals from circuits 400-409 are also supplied to 
video processors for extraction of digital chroma and luminance data." 
17: 55-57. 

"In the FIG. 9 embodiment, circuit 220 receives ten video inputs. The 
first nine inputs are received at buffer amplifier/digitizer 400, buffer 
amplifier/digitizer 408, and seven buffer amplifier/digitizer circuits 401- 
407 (not shown in FIG. 9) identical to circuits 400 and 408." 17: 22-27. 

"The buffered output of each of the first unit gain amplifiers is digitized by 
an A-to-D converter within each of circuits 400-409." 17: 41-43. 

FIG. 9, includinq A/D Converters 400 and 408 and accompanyinq text 


15.4 


a computer configured to receive the 
digitally compressed images, the computer 
being interfaced to the following devices* 


"The control module includes a computer programmed to control the 
other system components, and may also include the recording unit.... 
The programmed computer may use the active microphone signal to 
generate control signals for causing the video image corresponding to 
the active microphone to be displayed in a large picture area of the 
system's video monitors." 3: 33-46. 

FIGS. 5-8, includinq Computer 68 and accompanyinq text. 


15.5 


a display screen, 


"The system includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images In 
small picture regions of the monitor screen." 2: 67 • 3: 2. 

At the remote module (shown in FIG. 2), remote conferee 5 is provided 
with one or more video monitors (such as monitors 15, 16, 17, and 18) 
for viewing the output of local module cameras 21 , 22, 23, and 24." 5: 
13-16. 

FIG. 2 and accompanyinq text. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal- 
state image scene associated with at 
least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 


Means to receive externally derived operator commands is control 
console. 

"Control console may include controls such as audio volume controls, or 
controls for switching the assignments of the video signals between 
different remote module monitors." 5: 44-47. 
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derived command, and 


"An active, voice sensilive switching means (such as that described 
below with reference to FIGS. 4-6) selects a video signal from any one of 
cameras 21-24 for display as "principal" image on principal monitor 1 5. 
The voice sensitive switching means continually updates the principal 
video signal selection." 5: 59-64. 

"...and major components of the system's control module (which is 
operated by technician 6)." 4: 41-43. 

FIG. 1, including Console 25 and accompanying text. 

FIG. 2, including Console 19 and Technician 6 and accompanying text. 


15.7 


a high-capacity storage medium, and 
programmed to perform the foliDwing 
functions: 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio record oi a conference." 
Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs").,," 3: 35-37. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 58-61. 

"The other inputs of SW-1 are connected,., lo the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors." 11: 32-39. 

FIG. 2 and accompanying text. 

FIGS. 5 and 7, including Playback Record 64-66 and Storage Unit 67 
and accompanying text. 


15.8 


display the digitally compressed 
images from the cameras in different 
windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


"The system also includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

Discloses various embodiments involving a principal video image 
displayed in "large picture region" of monitor and several secondary 
images displayed in "small picture regions." FIG. 4A, FIG. 4B. 

"The video and signals to be displayed on the monitors and output by 
the loudspeakers are supplied from cable 40 through cable 30." 4: 61- 
63. 

FIG. 5, including Monitors and accompanying text. 
FIG. 7, inciudinq Monitors and accompanyinq text. 


15.9 


vary the dimensions and the rate al 
which a particular image is updated in 
sis window in accordance with one of 
the externally derived commands, 


Discloses "active, voice sensitive switching means" that "may be 
employed to select a "principal" image for display on the large picture 
region of a video monitor's screen" and thereby altering the image's 
dimensions. 9: 29-35. 

"The system also includes a monitor for each conferee, which displays a 
composite video signal including a principal video image in a large 
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picture region of the monitor screen and secondary video images in 
small picture regions of the monitor screen." Abstract. 

Discloses various embodiments involving a principal video image 
displayed in "large picture region" of monitor and several secondary 
images displayed In "small picture regions." FIG. 4A, FIG. 4B. 

FIG. 5, including Monitors and accompanying text. 
FIG. 7, including Monitors and accompanyinq text. 


15.10 


slore the digitally compressed images 
in the high-capacity storage medium, 
and 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio record of a conference." 
Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3: 35-37. 

"All or some of the video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 58-61. 

"The other inputs of SW-1 are connected... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors." 11:32-39. 

FIG. 2 and accompanying text. 

FIGS. 5 and 7, including Playback Record 64-66 and Storage Unit 67 
and accompanying text. 


15.11 


vary the dimensions and the rate at 
which a particular image is stored in 
accordance with one of the externally 
derived commands. 


"The system preferably also includes a recording unit for producing a 
permanent, combined video and audio record of a conference." 
Abstract. 

"The recording unit may include one or more video cassette recorders 
("VCRs")..." 3: 35-37. 

"Ail or some of She video signals arriving at the control module may be 
displayed on monitors 60, 61, 62, and 63 and recorded by video 
recording units 64, 65, and 66." 6: 58-61. 

"The other inputs of SW-1 are connected... to the output of video signal 
storage unit 65. Switch SW-1 selects the output of storage unit 65 in 
order to play back a video program stored in unit 65 to the local and 
remote module monitors." 11: 32-39. 

FIG. 2 and accompanying text. 

FIGS. 5 and 7, including Playback Record 64-66 and Storage Unit 67 
and accompanying text 
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Asserted claims 


Kutner 


0.1 


8. The method of simultaneously displaying 
and storing multiple video images, 
comprising the steps of: 


"A system for simultaneous display of multiple video windows on a 
display device. The system includes a primary interface for receiving a 
primary video signal and a primary storage memory for storing data 
representing the primary video signal," Abstract. 

"...a primary video interface (video interface 610) and primary buffer 
memory (buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces (video interfaces 610, 61 1 , 
612, and 613) and a buffer memory (buffer memory 641) are dedicated 
to receiving and storing the input of a plurality of video signals..." 4: 1-4, 


8.2 


receiving video images from a plurality of 
sources; 


"The present system includes a primary interface for receiving a primary 
video signal," 3; 3: 3-4, 

"The present system further includes a secondary interface for receiving 
a plurality of secondary video siqnals." 3: 6-8. 


8.3 


digitizing one or more of the images if not 
already in digital form; 


"Each of video interface circuits converts the composite analog video 
signal to a digital video signal..." 4: 17-19. 

"Input control circuit 631 directs the processed digitized video data 
stream and timing information from video interface 61 1 to be written into 
FIFO memory 621," 5:8-11. 

FIGS. 6-B, including Video Interface Circuits 610-613 and Input Control 
631 and accompanying text. 


8.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"Buffer memory 640 is dedicated to storage of only information related to 
primary video imagery which is intended for display in a main window on 
a display monitor." 6: 26-28. 

"Buffer memory 641, on the other hand, Is dedicated to storage of 
information related to a plurality of video images each of which is 
intended for display in one of the plurality of secondary windows on 
display monitor which are either equal or smaller in size than the main 
window in which the primary video imagery is displayed." 6: 28-33. 

"Video data Is read at a speed appropriate for proper display on the 
monitor." 6: 34-35. 

"It will be noted that the input bandwidth of buffer memory 640 is 
preferably sufficiently large that it can accommodate the data rate 
required to display any size live video window on the display monitor." 4: 
66-5:3. 

"In the preferred embodiment, the input bandwidth of the buffer memory 
641 is sufficiently large that it can accommodate the data rate 
requirements of one live video window of any size," 6: 10-13. 

FIG. 2, 9 and accompanying text. 

FIG. 3-5, including Monitor 390 and accompanying text. 

FIG. 6-9, includinq Monitor 670 and accompanyinq text. 


8.5 


simultaneously storing the displayed 


"...a primary video interface (video interface 610) and primary buffer 
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images using a second, predetermined 
frame rate and resolution associated with 
each image. 


memory (buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces (video interfaces 610, 611, 
612, and 613) and a buffer memory (buffer memory 641 ) are dedicated 
to receiving and storing the input of a plurality of video signals..." 4: 1-4. 

"It will be noted that the input bandwidth of buffer memory 640 is 
preferably sufficiently large that it can accommodate the data rate 
required to display any size live video window on the display monitor." 4: 
66-5: 3. 

"In the preferred embodiment, the input bandwidth of the buffer memory 
641 is sufficiently large that it can accommodate the data rate 
FBCjUiremsnts of oris livB vidso window of any siz6." 6i 1 0**1 3. 

FIG. 6, including Video Interfaces 610-613 and Buffer Memories 640 and 
641 and accompanying text. 

FIG. 7, including Buffer Memories 640 and 641 and accompanying text. 
FIG. 8, including Buffer Memories 640 and 641 and accompanyinq text. 


12.1 


12. The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"A system for simultaneous display of multiple video windows on a 
display device. The system includes a primary interface for receiving a 
primary video signal and a primary storage memory for storing data 
representing the primary video signal." Abstract. 

"...a primary video interface (video interface 610) and primary buffer 
memory (buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces (video interfaces 610, 611, 
612, and 613) and a buffer memory (buffer memory 641) are dedicated 
to receiving and storing the input of a plurality of video signals..." 4: 1-4. 


12.2 


receiving video images from a plurality of 
sources; 


"The present system includes a primary interface for receiving a primary 
video signal." 3; 3; 3-4. 

"The present system further includes a secondary interface for receiving 
a plurality of secondary video signals." 3: 6-8. 


12.3 


digitizing one or more of the images if not 
already in digital form; 


"Each of video interface circuits converts the composite analog video 
signal to a digital video signal..." 4: 17-19. 

Input control circuit 631 directs the processed digitized video data 
stream and timing information from video interface 61 1 to be written into 
FIFO memory 621." 5:8-11. 

FIG. 6-8, including Video Interface Circuits 610-613 and Input Control 
631 and accompanyinq text. 


12.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first set of temporal and 
spatial parameters associated with each 
image in each window; 


Discloses display of primary video image in "main" window on display 
monitor. 

Plurality of secondary video signals are stored in secondary windows. 
"Each of the secondary windows is smaller in area than the main video 
window." 8:39-41. 
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"It will be noted that the input bandwidth of buffer memory 640 is 
preferably sufficiently large that it can accommodale the data rate 
required to display any size live video window on the display monitor." 4: 
66-5:3. 

"In the preferred embodiment, the input bandwidth of the buffer memory 
641 is sufficiently large that it can accommodate the data rate 
requirements of one live video window of any size." 6: 10-13. 

FIG. 2, 9 and accompanying text. 

FIG. 3-5, including Monitor 390 and accompanying text 

FIG. 6-9, including Monitor 670 and accompanying text. 


12.5 


simultaneously storing the displayed 
images using a second set of temporal and 
spatial parameters associated with each 
image. 


Discloses that "video interfaces 611, 612, and 613 must reduce the size 
of the video image to be displayed... such that the total bandwidth does 
not exceed the bandwidth capacity of the buffer memory 641." 6: 14-18. 

"...a primary video interface {video interface 610) and primary buffer 
memory {buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces (video interfaces 61 0, 61 1 , 
612, and 613) and a buffer memory (buffer memory 641) are dedicated 
to receiving and storing the input of a plurality of video signals..." 4: 1-4. 

"It will be noted that the input bandwidth of buffer memory 640 is 
preferably sufficiently large that it can accommodate the data rate 
required to display any size live video window on the display monitor." 4: 
66 - 5: 3. 

"in the preferred embodiment, the input bandwidth of the buffer memory 
641 is sufficiently large that it can accommodate the data rate 
requirements of one live video window of any size." 6: 10-13. 

FIG. 6, including Video Interfaces 610-613 and Buffer Memories 640 and 
641 and accompanying text. 

FIG. 7, including Buffer Memories 640 and 641 and accompanying text. 
FIG. 8, including Buffer Memories 640 and 641 and accompanying text. 


15.1 


15. A video storage and display system, 
comprising: 


"A system for simultaneous display of multiple video windows on a 
display device. The system includes a primary interface for receiving a 
primary video signal and a primary storage memory for storing data 
representing the primary video signal." Abstract. 

"...a primary video interface (video interface 610) and primary buffer 
memory (buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces (video interfaces 610, 61 1 , 
612, and 613) and a buffer memory (buffer memory 641) are dedicated 
to receivinq and storinq the input of a plurality of video signals..." 4: 1-4. 


15.2 


a plurality of video cameras, each 
outpurting a signal representative of a video 


Discloses the receipt of multiple video signals by the video interface 
circuits. 
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image; 


FIG. 3-6, including Video Interface Circuits and accompanying text. 


15.3 


means to receive the signals from each 
camera and digitally compress the images; 
and 


Means to receive the signals from each camera and digitally compress 
the images is Video Interface Circuits. 




"...a primary video interface and primary buffer memory are dedicated to 
receiving and storing the input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces and a buffer memory are 
dedicated to receiving and storing the input of a plurality of video 
signals,,," 4: 1-4. 

"Each of video interface circuits converts the composite analog video 
signal to a digital video signal..."' 4: 17-19. 

"Input control circuit 631 directs the processed digitized video data 
stream and timing information from video interface 611 to be written into 
FIFO memory 621." 5:8-11. 

FIG. 3-8, including Video Interface Circuits and accompanying text. 
FIG. 6-6, includinq Input Control 631 and accompanying text. 




a computer configured to receive the 
digitally compressed images, the computer 
being interfaced to the following devices: 


System discloses "control processor" which "stores data in output control 
memory which determines for each pixel on the display monitor whether 
to output the contents of buffer memory 640 or buffer memory 641." 6: 
45-49. 

FIG. 6-8, includinq Control Processor 690 and accompanying text. 


15.5 


a display screen, 


"...representing a primary video image which it is desired to have 
displayed in the largest of a plurality of windows displayed on a single 
display device, monitor 670." 3: 65 - 4: 1 . 

"The video signal J applied to the input of video interface 610 
corresponds to an image which it is desired to have appear in the largest 
of the multiple windows which will be displayed on the single display 
monitor 670." 4:28-30. 

FIG. 2, 9 and accompanying text. 

FIG. 3-5, including Monitor 390 and accompanying text. 

FIG. 6-9, including Monitor 670 and accompanying text. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal* 
state image scene associated with at 
least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 
derived command, and 


To the extent the reference does not explicitly disclose means to receive 
externally derived operator commands including means for sensing a 
deviation from the normal-state image scene associated with at least 
one of the video cameras, this limitation is inherent in this disclosure. 


15.7 


a high-capacity storage medium, and 
programmed to perform the following 
functions: 


"It will be noted that the input bandwidth of buffer memory 640 is 
preferably sufficiently large that it can accommodate the data rate 
required to display any size live video window on the display monitor." 4: 
66-5:3. 
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"In the preferred embodiment, the input bandwidth of the buffer memory 
641 is sufficiently large that it can accommodate the data rate 
requirements of one live video window of any size." 6: 1 0-1 3. 

"...a primary video interface (video interface 610) and primary buffer 
memory (buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal,,," 3: 62-65, 

"A plurality of secondary video interfaces (video interfaces 610, 611, 
612, and 613) and a buffer memory (buffer memory 641) are dedicated 
to receiving and storing the input of a plurality of video signals..." 4:1-4. 

FIG. 6, including Video Interfaces 610-613 and Buffer Memories 640 and 
641 and accompanying text. 

FIG. 7, including Buffer Memories 640 and 641 and accompanying text. 
FIG. 8, including Buffer Memories 640 and 641 and accompanying text. 


15.8 


display the digitally compressed 
images from the cameras in different 
windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


"...and for outputting primary pixel values representing said primary 
window;.. .and for outputting secondary pixel values representing said 
secondary video windows;" Claim 1 . 

"...primary video imagery which is intended for display in a main window 
on a display monitor." 6: 27-28. 

"...a plurality of video images each of which is intended for display in one 
of the plurality of secondary windows on display monitor..." 6: 29-32. 

"It will be noted that the video interface circuits 610, 611, 612, and 613 
may be utilized to process the digital video signal by adding or dropping 
video pixels to increase or decrease the size of the digitized video image 
or images." 4: 20-24. 

"....the position of the live video image on the display monitor can be 
controlled since each address location corresponds to a particular pixel, 
or pixels, on the monitor." 4: 47-50. 

FIG. 2, 9 and accompanying text. 

FIG. 3-5, including Monitor 390 and accompanying text. 

FIG. 6-9, including Monitor 670 and accompanying text. 


15.9 


vary the dimensions and the rate at 
which a particular image is updated in 
its window in accordance with one of 
the externally derived commands, 


"A system for simultaneous display of multiple video windows on a 
display device. The system includes a primary interface for receiving a 
primary video signal and a primary storage memory for storing data 
representing the primary video signal." Abstract. 

To the extent the reference does not explicitly disclose externally derived 
operator commands, this limitation is inherent in this disclosure. 


15.10 


store the digitally compressed images 
in the high-capacity storage medium, 
and 


"It will be noted that the input bandwidth of buffer memory 640 is 
preferably sufficiently large that it can accommodate the data rate 
required to display any size live video window on the display monitor." 4: 
66 - 5: 3. 

"In the preferred embodiment, the input bandwidth of the buffer memory 
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641 is sufficiently large that it can accommodate the data rate 
requirements of one live video window of any size." 6: 10-13, 

"...a primary video interface (video interface 610) and primary buffer 
memory (buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces (video interfaces 610, 61 1, 
612, and 613) and a buffer memory (buffer memory 641) are dedicated 
to receiving and storing the input of a plurality of video signals..." 4; 1-4. 

FIG. 6, including Video Interfaces 610-613 and Buffer Memories 640 and 
641 and accompanying text. 

FIG. 7, including Buffer Memories 640 and 641 and accompanying text. 
FIG. 8, including Buffer Memories 640 and 641 and accompanyinq text. 


15.11 


vary the dimensions and the rate al 
which a particular image is stored in 
accordance with one of the externally 
derived commands. 


"It will be noted that the input bandwidth of buffer memory 640 is 
preferably sufficiently large that it can accommodate the data rate 
required to display any size live video window on the display monitor." 4: 
66-5: 3. 

"...a primary video interface (video interface 610) and primary buffer 
memory (buffer memory 640) are dedicated to receiving and storing the 
input of a primary video signal..." 3: 62-65. 

"A plurality of secondary video interfaces (video interfaces 610, 611, 
612, and 613) and a buffer memory (buffer memory 641) are dedicated 
to receiving and storing the input of a plurality of video signals..." 4: 1-4. 

FIG. 6, including Video Interfaces 610-613 and Buffer Memories 640 and 
641 and accompanying text. 

FIG. 7, including Buffer Memories 640 and 641 and accompanying text. 
FIG. 8, including Buffer Memories 640 and 641 and accompanying text. 

To the extent the reference does not explicitly disclose externally derived 
operator commands, this limitation is inherent in this disclosure. 
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Asserted claims 


Lohodzinski 


8.1 


8. The method of simultaneously displaying 
and storing multiple video images, 
comprising the sleps of: 


"A motion video system and melhod for use... for combining the 
acquisition, display, and processing of digital video in real-time... 
through the use of a mass storage device and digital motion video data 
compression/decompression." Abstract. 

"A multiple video stream display is shown in FIG 6." 12: 43-44. 

"...a plurality of digital video streams can be displayed simullaneously on 
the internal display monitor or the external display monitor," 12: 54-56, 

FIG. 1 and accompanying text. 


8.2 


receiving video images from a plurality of 
sources; 


Discloses plurality of video streams retrieved from compressed 
(archived) video data from the mass storaqe device. 


8.3 


digitizing one or more of the images if not 
already in digilai form; 


"The VP 1 digitizes the analog RF signal 35, performs video 
compression, and then stores the data to the mass storage device 7." 
10: 14-16. 

In one application, the [Ultrasound] has the capability of digitizing the 
MTVS [Motion Video Transformation System] analog video output signal 
in A/D converter shown in FIG. 2 for subsequent display on the internal 
display monitor." 10: 33-36. 

"The video signal 14 can be generated in either analog or digital format." 
8:12-13. 

FIG. 1, including VP [Video Processor] 1 and accompanying text. 
FIG. 2, including AD Converter 33 and accompanying text. 


8.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"Each display window stream may also be displayed at a different frame 
rate." 12: 62-64. 

"A multiple video stream display is shown in FIG 6." 12: 43-44, 

"...a plurality of digital video streams can be displayed simullaneously on 
the internal display monitor or the external display monitor." 12: 54-56. 

"The MVTS comprises components or subsystems that operate to:. ..(4) 
enhance the display of video data through spatial and temporal domain 
processing." 6:2-9. 

"The side-by-side display of diagnostic video in scalable windows in the 
system of the present invention can accommodate more than four 
independent bit streams played back directly form the storage media..." 
5: 30-33. 

"Another component comprises a video display processor which allows 
for display of multiple digital motion video streams in respective scalable 
windows." B: 46-4B. 

FIG. 1-2, including Video Display Processor 1 and Monitor 13 and 

accompanying text. 

FIG. 6 and accompanying text. 

FIG, 8 and. accompanying text, 
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8.5 


simultaneously storing the displayed 
images using a second, predetermined 
frame rate and resolution associated with 
each image. 


"A motion video system and method for use,., for combining the 
acquisition, display, and processing of digital video in real-time... 
through the use of a mass storage device and digital motion video data 
compression/decompression." Abstract. 

"The computer combines this information with compressed video data 
prior to storage to the mass storage device." 14; 33-35. 

"The US 200 is also capable of archiving uncompressed digital video to 
an archival storage unit 30." 1 0: 8-9. 

"Video streams may be recorded at different frame rates depending 
upon the DIS (Diagnostic Imaging System) 17." 13: 58-59. 

FIG, 1, including Mass Storage Device 7 and accompanying text. 
FIG, 2, including Archival Storage Unit 30 and accompanying text. 


12.1 


12, The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"A motion video system and method for use... for combining the 
acquisition, display, and processing of digital video in real-time... 
through the use of a mass storage device and digital motion video data 
compression/decompression." Abstract. 

"A multiple video stream display is shown in FIG 6." 12: 43-44. 

",.,a plurality of digital video streams can be displayed simultaneously on 
the internal display monitor or the external display monitor." 1 2: 54-56. 

FIG. 1 and accompanyinq text. 


12.2 


receiving video images from a plurality of 
sources; 


Discloses plurality of video streams retrieved from compressed 
(archived) video data from the mass storage device. 


12.3 


digitizing one or more of the images if not 
already in digital form; 


"The VP 1 digitizes the analog RF signal 35, performs video 
compression, and then stores the data to the mass storage device 7." 
10:14-16. 

"In one application, the [Ultrasound] has the capability of digitizing the 
MTVS [Motion Video Transformation System] analog video output signal 
in A/D converter shown in FIG. 2 for subsequent display on the internal 
display monitor." 10; 33-36. 

"The video signal 14 can be generated in either analog or digital format." 
8:12-13. 

FIG. 1, including VP [Video Processor] 1 and accompanying text. 
FIG. 2, including AD Converter 33 and accomoanvina text. 


12.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first set of temporal and 
spatial parameters associated with each 
image in each window; 


"Each display window stream may also be displayed at a different frame 
rate." 12: 62-64, 

"A multiple video stream display is shown in FIG 6." 12' 43-44 

"...a plurality of digital video streams can be displayed simultaneously on 
the internal display monitor or the external display monitor." 12: 54-56. 

"The MVTS comprises components or subsystems that operate to:. ,.(4) 
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enhance the display of video dala through spatial and temporal domain 
processing." 6: 2-9, 

"The side-by-side display of diagnostic video in scalable windows in the 
system of the present invention can accommodate more than four 
independent bit streams played back directly form the storage media..." 
5: 30-33. 

"Another component comprises a video display processor which allows 
for display of multiple digital motion video streams in respective scalable 
windows." 6:46-48. 

FIG. 1-2, including Video Display Processor and Monitor 13 and 

accompanying text. 

FIG. 6 and accompanying text. 

FIG. 8 and accompanying text. 


12.5 


simultaneously storing the displayed 
images using a second set of temporal and 
spatial parameters associated with each 
image. 


"A motion video system and method for use... for combining Ihe 
acquisition, display, and processing of digital video in real-time... 
through Ihe use of a mass storage device and digital motion video data 
compression/decompression." Abstract. 

"The computer combines this information with compressed video data 
prior to storage to the mass slorage device." 14: 33-35. 

"The US 200 is also capable of archiving uncompressed digital video to 
an archival storage unit 30." 10: 8-9. 

'Video streams may be recorded at different frame rates depending 
upon the DIS (Diagnostic Imaging System) 17." 13: 58-59. 

FIG. 1, including Mass Storage Device 7 and accompanying text. 
FIG. 2, including Archival Storage Unit 30 and accompanying text. 


15.1 


15. A video storage and display system, 
comprising: 


"A motion video system and method for use... for combining the 
acquisition, display, and processing of digital video in real-time- 
through the use of a mass storage device and digital motion video dala 
compression/decamp ression . " Abstract. 

"...a plurality of digital video streams can be displayed simultaneously on 
the internal display monitor or the external display monitor." 1 2: 54-56. 

FIG. 1 and accompanying text 


15.2 


a plurality of video cameras, each 
outputting a signal representative of a video 
image; 


Discloses plurality of video streams retrieved from compressed 
(archived) video data from the mass slorage device. 

To the extent the reference does not explicitly disclose a plurality of 
video cameras, this limitation is inherent in this disclosure. 


15.3 


means to receive the signals from each 
camera and digitally compress the images; 
and 


Means to receive the signals from each camera and digitally compress 
the images is Video Processor 1, Video Transformation 47, and AD 
Converter 33. 
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"According to the present invention, a video signal in any of analog input 
formats, or the digital input format, generated by the US, is passed via 
the buffer, the source selector, and the input video bus to the VT 47 for 
compression... The decompressed digital output is then forwarded to the 
VDP 10." 11:32-49. 

"The VP 1 digitizes the analog RF signal 35, performs video 
compression, and then stores the data to the mass storage device 7." 
10:14-16. 

"In one application, the [Ultrasound] has the capability of digitizing the 
MTVS [Motion Video Transformation System] analog video output signal 
in A/D converter shown in FIG. 2 for subsequent display on the internal 
display monitor." 10: 33-36, 

"The video signal 14 can be generaled in either analog or digital format." 
8:12-13. 

FIG. 1, including VP [Video Processor] 1 and accompanying text, 

FIG. 2, including AD Converter 33 and accompanying text. 

FIG. 3, including Video Transformation 47 and accompanying text. 


15.4 


a computer configured to receive (he 
digitally compressed images, the computer 
being interfaced to the following devices: 


"The computer, in its preferred embodiment, is a standard original 
equipment manufacturer's computer, with the following..." 9: 13-15. 

Discloses computer connected to "video processor" that receives and 
compresses the video signal. 

FIGS. 1 & 9, including Computer 6 and accompanyinq text. 


15.5 


a display screen, 


"...a plurality of digital video streams can be displayed simultaneously on 
the internal display monitor or the external display monitor." 12: 54-55. 

FIG. 1, including Monitor 13 and accompanying text. 

FIG, 2, including Display Monitor 25 and accompanyinq text. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal- 
state image scene associated with at ■ 
least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 
derived command, and 


Means to receive externally derived operator commands is Control 
Output Interface 4. 

"...the selection of a record button will begin the archiving of the digital 
video with underlying audio, physiological signs, and timing EEG marks 
to the mass storage device. The recording will continue until the 
selection of a stop button or a stop issued by the control output interface 
4." 11:59-64. 

"The playback of compressed digital video and audio from the storage 
media starts with the selection of a play button and continues until a stop 
button is selected or a stop control signal issued by the control output 
interface." 12:3-6. 

FIGS. 1-2, including Control Output Interface 4 and accompanyinq text. 


15.7 


a high-capacity storage medium, and 
programmed to perform the following 
functions: 


"A motion video system and method for use... for combining the 
acquisition, display, and processing of digital video in real-time... 
through the use of a mass storage device and digital motion video data 
compression/decompressio n . " Abstract. 
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"The computer combines this information with compressed video dala 
prior to storage to the mass storage device." 14: 33-35. 

"The US 200 is also capable of archiving uncompressed digital video to 
an archival storage unit 30." 10: 8-9. 

"Video streams may be recorded at different frame rates depending 
upon the DIS (Diagnostic Imaging System) 17." 13: 58-59. 

FIG. 1, including Mass Storage Device 7 and accompanying text. 
FIG. 2, including Archival Storage Unit 30 and accompanyinq text. 


15.8 


display the digitally compressed 
images from the cameras in different 
windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


"If more than one selection has been made, the MTVS will automatically 
adjust the display area to accommodate the selected video streams 
representing the diagnostic studies." 12: 39-42. 

"Each display window stream may also be displayed at a different frame 
rate." 12: 62-64. 

"A multiple video stream display is shown in FIG 6." 12: 43-44. 

"...a plurality of digital video streams can be displayed simultaneously on 
the internal display monitor or the external display monitor." 1 2: 54-56. 

"The MVTS comprises components or subsystems that operate to:.. .(4) 
enhance the display of video data through spatial and temporal domain 
processing." 6: 2-9. 

"The side-by-side display of diagnostic video in scalable windows in the 
system of the present invention can accommodate more than four 
independent bit streams played back directly form the storage media..." 
5: 30-33. 

"Another component comprises a video display processor which allows 
for display of multiple digital motion video streams in respective scalable 
windows." 6: 46-48. 

FIG. 1-2, including Video Display Processor 1 and Monitor 13 and 

accompanying text. 

FIG. 6. and accompanying text. 

FIG. B, and accompanyinq text. 


15.9 


vary the dimensions and the rale at 
which a particular image is updated in 
its window in accordance with one of 
the externally derived commands, 


Discloses "playback process" which is initiated by "software generated 
control buttons." "The playback modes include slow motion (inter frame 
interval longer than at the time of recording) and fast motion (inter frame 
interval shorter than at the time of recording)." 12: 7-16. 

'...the selection of a record button will begin the archiving of the digital 
video with underlying audio, physiological signs, and timing EEG marks 
to the mass storage device. The recording will continue until the 
selection of a stop button or a stop issued by the control output interface 
4." 11:59-64. 


15.10 


store the digitally compressed images 
in the high-capacity storage medium, 


Discloses a "mass storage device" where the compressed video data is 
stored. 5: 42; 6: 10; 7: 8; 9: 27; 11: 42; 11: 62; 13: 23; 14: 44. 
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and 


FIG. 1, including Mass Storage Device 7 and accompanying text. 


15.11 


vary the dimensions and the rate at 
which a particular image is stored in 
accordance with one of the externally 
derived commands. 


"A motion video system and method far use... for combining the 
acquisition, display, and processing of digital video in real-time... 
through the use of a mass storage device and digital motion video data 
compression/d ecompression . " Abstract. 

"The computer combines this information with compressed video data 
prior to storage to the mass storage device." 14: 33-35. 

"The US 200 is also capable of archiving uncompressed digital video to 
an archival storage unit 30." 10: B-9. 

"Video streams may be recorded at different frame rates depending 
upon the DIS {Diagnostic Imaging System) 17." 13: 58-59. 

"...the selection of a record button will begin the archiving of the digital 
video with underlying audio, physiological signs, and timing EEG marks 

selection of a stop button or a stop issued by the control output interface 
4." 11:59-64. 

FIG. 1, including Mass Storage Device 7 and accompanying text. 
FIG. 2, including Archival Storage Unit 30 and accompanying text. 
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Asserted claims 


Gormley 


8.1 


8. The method of simultaneously displaying 
and storing multiple video images, 
comprising the steps of: 


"Monitoring apparatus for a securily system comprises a monitor and 
twelve video cameras." Abstract. 

"The crux of the present invention is the generation... of a plurality of 
complete images of different sizes as a single composite picture on a 
single monitor..." 2: 37-40. 

"In some forms of security system...the system will also include a video 
storage unit." 4: 57-59. 

FIG. 1A and accompanying text. 


8.2 


receiving video images from a plurality of 
sources; 


Discloses invention featuring 12 video cameras, each submitting its own 
video signal lo be displayed on a single monitor. 

"In a security system, the system will comprise the video monitoring 
apparatus and will also include a number of video cameras... and 
providing the pictures to be displayed on the monitor." 4: 25-29. 

"12 cameras C1 to C12 are directed at locations of interest, and feed 12 
input channels of an effects module 20, which in turn feeds the monitor 
21." 7:3-6. 

FIG. 2, including C1-C12 and accompanying text. 


8.3 


digitizing one or more of the images if not 
already in digital form; 


"An effects unit 20 includes a buffer memory 24 and a set of 1 3 video 
compression units 23." Abstract. 

"The effects module comprises a video compression unit 23.. .Unit 23 
comprises 13 sections, corresponding to the 1 3 input channels to the 
effects unit." 7: 13-16. 

FIG. 2 and accompanyinq text. 


8.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"Selection means 25 select any desired one of the camera outputs for 
display as the large image." Abstract. 

"In a securily system, the system will comprise the video moniloring 
apparatus and will also include a number of video cameras... and 
providing the pictures to be displayed on the monitor." 4: 25-29. 

"The usual mode of operation of the system will generally be a simple 
select mode, in which there are 12 (at most) video sources each 
displayed as a corresponding small image, with selection means 
operating to permit the duplication of the selected image in the large 
zone." 4: 44-49. 

"The effects module 20 comprises a video compression unit 23 and a 
read/wrile buffer 24. Unit 23 comprises 13 sections, corresponding to 
the 13 input channels to the effects unit. The first 12 sections of unit 23 
are identical, and each compresses the incoming signal by a ratio fo 
16:1 {corresponding to the 4:1 linear size reduction of the small image 
zones). The final section compresses the incoming signal by a ratio of 
4:1 (corresponding to the 2:1 linear size reduction of the large image 
zone)." 7:13-21. 
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Discloses several alternative arrangements regarding the window size 
and number of the video images displayed on the single monitor, all of 
which contain a "central large zone" (i.e., a particular image thai has 
been chosen to be the large image). 2: 37 - 3: 24. 

FIGS. 1 and 1A and accompanying texl. 

FIG. 2, including SEL 25 and accompanying text. 

FIG. 2, including Mon Z1 , 32, 33 and 42 and accompanying text. 


B.5 


simultaneously storing the displayed 
images using a second, predetermined 
frame rate and resolution associaled with 
each image. 


"An effects unit 20 includes a buffer memory 24 and a set of 13 video 
compression units 23." Abstract. 

"In some forms of security system. ..the system will also include a video 
image storage unit." 4: 57-59. 

"...the effects unit 20 could contain a set of 12 separate memories, one 
for each camera." 8: 4-5. 

"The output of the video recorder is passed, via a monitor 42, to the stills 
unit 31. This permits an image recorded by the system to be copied into 
the stills unit for future reference." 9: 22-25. 

FIG. 2 and accompanying text 


12.1 


12. The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"Monitoring apparatus for a security system comprises a monitor and 
twelve video cameras." Abstract. 

"The crux of the present invention is the generation... of a plurality of 
complete images of different sizes as a single composite picture on a 
single monitor..," 2: 37-40. 

"In some forms of security system. ..the system will also include a video 
storage unit." 4: 57-59. 

FIG. 1A and accompanying text. 


12.2 


receiving video images from a plurality of 
sources; 


Discloses invention featuring 12 video cameras, each submitting its own 
video signal to be displayed on a single monitor. 

"In a security system, the system will comprise the video monitoring 
apparatus and will also include a number of video cameras... and 
providing the pictures to be displayed on the monitor." 4: 25-29. 

"12 cameras C1 to C12 are directed allocations of interest, and feed 12 
input channels of an effects module 20, which in turn feeds the monitor 
21." 7:3-6. 

FIG. 2, includinq C1-C12 and accompanying text. 


12.3 


digitizing one or more of the images if not 
already in digital form; 


"An effects unit 20 includes a buffer memory 24 and a set of 13 video 

"The effects module comprises a video compression unit 23.. .Unit 23 
comprises 13 sections, corresponding to the 13 input channels to the 
effects unit." 7:13-16. 
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FIG. 2 and accompanying text. 


12.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first set of temporal and 
spatia! parameters associated with each 
image in each window; 


"Selection means 25 select any desired one of the camera outputs tor 
display as the large image." Abstract. 

"In a security system, the system will comprise the video monitoring 
apparatus and wiil also include a number of video cameras.,, and 
providing the pictures to be displayed on the monitor." 4: 25-29. 

"The usual mode of operation of the system will generally be a simple 
select mode, in which there are 1 2 (at most) video sources each 
displayed as a corresponding small image, with selection means 
operating to permit the duplication of the selected image in the large 
zone." 4: 44-49. 

"The effects module 20 comprises a video compression unit 23 and a 
readfwrite buffer 24. Unit 23 comprises 13 sections, corresponding to 
the 13 input channels to the effects unit. The first 12 sections of unit 23 
are identical, and each compresses the incoming signal by a ratio fo 
16:1 (corresponding to the 4:1 linear size reduction of the small image 
zones). The final section compresses the incoming signal by a ratio of 
4:1 (corresponding to the 2:1 linear size reduction of the large image 
zone)." 7:13-21. 

Discloses several alternative arrangements regarding the window size 
and number of the video images displayed on the single monitor, all of 
which contain a "central large zone" (i.e., a particular image that has 
been chosen to be the large image). 2: 37 - 3: 24. 

FIGS. 1 and 1A and accompanying text. 

FIG. 2, including SEL 25 and accompanying text. 

FIG. 2, includinq Mon Z1, 32, 33 and 42 and accompanyinq text. 


12.5 


simultaneously storing the displayed 
images using a second set of temporal and 
spatial parameters associated with each 
image. 


"An effects unit 20 includes a buffer memory 24 and a set of 13 video 
compression units 23." Abstract. 

"In some forms of security system.. .the system will also include a video 
image storage unit." 4: 57-59. 

"...the effects unit 20 could contain a set of 12 separate memories, one 
for each camera." 8:4-5. 

"The output of the video recorder is passed, via a monitor 42, to the stills 
unit 31. This permits an image recorded by the system to be copied into 
the stills unit for future reference." 9: 22-25. 

FIG. 2 and accompanyinq text. 


15.1 


15. A video storage and display system, 
comprising: 


"Monitoring apparatus for a security system comprises a monitor and 
twelve video cameras." Abstract. 

"The crux of the present invention is the generation... of a plurality of 
complete images of different sizes as a single composite picture on a 
single monitor..." 2: 37-40. 



3 



# 


USP 5,625,410 


U.S. Patent No. 5,258,837 
Filing date: 10719/1992 
Issue date: 11/2/1993 






In some forms of security system. ..the system will also include a video 
storage unit." 4: 57-59. 






FIG. 1A 


15.2 


a plurality of video cameras, each 
outputting a signal representative of a video 
image; 


Discloses invention featuring 12 video cameras, each submitting its own 
video signal to be displayed on a single monitor. 

"In a security system, the system will comprise the video monitoring 
apparatus and will also include a number of video cameras... and 
providing the pictures to be displayed on the monitor." 4: 25-29. 

"12 cameras C1 to C12 are directed at locations of interest, and feed 12 

2r 7: 3-6. 

FIG. 2, including C1-C12 and accompanying text. 


15.3 


means to receive the signals from each 
camera and digitally compress the images; 
and 


Means to receive the signals from each camera and digitally compress 
the images is Effects Module 20 and Video Compression Unit 23. 




"12cameras C1 to C12are directed at locations of interest, and feed 12 
input channels of an effects module 20, which in turn feeds the monitor 
21." 7: 3-7. 

"An effects unit 20 includes a buffer memory 24 and a set of 13 video 
compression units 23." Abstract. 

"The effects module comprises a video compression unit 23.. .Unit 23 
comprises 13 sections, corresponding to the 13 input channels to the 
effects unit." 7: 13-16. 

FIG. 2 and accompanying text. 


15.4 


a computer configured to receive the 
digitally compressed images, the computer 
being interfaced to the following devices: 


"The effects module 20 comprises a video compression unit 23." 7: 13- 
14. 

"12 cameras C1 to C12 are directed at locations of interest, and feed 12 
input channels of an effects module 20, which in turn feeds the monitor 
21." 7:3-6. 

"The effects module 20 is also coupled to a video recorder 31 via dale 
and time stamp unit 30." 9: 9-10. 

FIG. 2 


15.5 


a display screen, 


Discloses a "single monitor" upon which all images are displayed. 2: 2; 
2:40. 

FIG. 2, including Mon Z1, 32, 33, and 42 and accompanying text. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal- 
stale image scene associated with at 
least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 


Means to receive externally derived operator commands is "selection 
means" which "may include a so-called "touch screen" control device 
attached directly over the video display screen." 4: 36-38. 

Specification notes it may become necessary for security officer to 
investigate suspicious activity on the monitor screen. Thus, patent 
providesfor "selection means for selecting any desired of the small 
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derived command, and 


images for display in the large area." 4: 33-35. 

"Touch screen* control device allows the security officer to "literally point 
his finger" at suspect individual on small image and thereby see that 
image duplicated on the central large image. 4: 36-43. 


15.7 


a high-capacity storage medium, and 
programmed io perform the following 
functions: 


"An effects unit 20 includes a buffer memory 24 and a set of 13 video 
compression units 23." Abstract. 

"in some forms of security system.. .the system will also include a video 
image storage unit." 4: 57-59. 

"...the effects unit 20 could contain a set of 12 separate memories, one 
for each camera." 8: 4-5. 

"The output of the video recorder is passed, via a monitor 42, to the stills 
unit 31. This permits an image recorded by the system to be copied into 
the stills unit for future reference." 9: 22-25. 

FIG. 2 and accompanying text. 


15.8 


display the digitally compressed 
images from the cameras in different 
windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


Discloses a "touch screen" control device (attached directly over 
monitor) that allows the security officer to "literally point his finger" at 
suspect individual on small image and thereby see that image duplicated 
on the central large image. 4: 36-43. 

"Selection means 25 select any desired one of the camera outputs for 
display as the large image." Abstract. 

"In a security system, the system will comprise the video monitoring 
apparatus and will also include a number of video cameras... and 
providing the pictures to be displayed an the monitor." 4: 25-29. 

"The usual mode of operation of the system will generally be a simple 
select mode, in which there are 12 (at most) video sources each 
displayed as a corresponding small image, with selection means 
operating to permit the duplication of the selected image in the large 
zone." 4: 44-49. 

"The effects module 20 comprises a video compression unit 23 and a 
read/write buffer 24. Unit 23 comprises 13 sections, corresponding to 
the 13 input channels to the effects unit. The first 12 sections of unit 23 
are identical, and each compresses the incoming signal by a ratio fo 
16:1 (corresponding to the 4:1 linear size reduction of the small image 
zones). The final section compresses the incoming signal by a ratio of 
4:1 (corresponding to the 2:1 linear size reduction of the large image 
zone)." 7:13-21, 

Discloses several alternative arrangements regarding the window size 
and number of the video images displayed on the single monitor, all of 
which contain a "central large zone" (i.e., a particular image that has 
been chosen to be the large image). 2: 37 - 3: 24. 

FIGS. 1 and 1A and accompanying text. 

FIG. 2, including SEL 25, Mon Z1, 32, 33 and 42 and accompanying 
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text. 


15.9 


vary the dimensions and the rate a! 
which a particular image is updated in 
its window in accordance with one of 
the externally derived commands, 


Discloses ability for security officer, via touch control device, rendering a 
small image to be duplicated in the large central area {i.e., made into a 
larger image). 

"Selection means 25 select any desired one of the camera outputs for 
display as the large image." Abstract. 

"In a security system, the system will comprise the video monitoring 
apparatus and will also include a number of video cameras.,, and 
providing the pictures to be displayed on the monitor." 4: 25-29. 

"The usual mode of operation of the system will generally be a simple 
select mode, in which there are 12 (at most) video sources each 
displayed as a corresponding small image, with selection means 
operating to permit the duplication of the selected image in the large 
zone." 4: 44-49. 

Discloses several alternative arrangements regarding the window size 
and number of the video images displayed on the single monitor, all of 
which contain a "central large zone" (i.e., a particular image that has 
been chosen to be the large image). 2: 37 - 3: 24. 

FIGS. 1 and 1A and accompanying text. 

FIG. 2, including SEL 25, Mon Z1 , 32, 33 and 42 and accompanying 

text. 


15.10 


store the digitally compressed images 
In the high-capacity storage medium, 
and 


"An effects unit 20 includes a buffer memory 24 and a set of 1 3 video 
compression units 23." Abstract, 




"In some forms of security system.. .the system will also include a video 
image storage unit." 4: 57-59. 

"...the effects unit 20 could contain a set of 12 separate memories, one 
for each camera." 8: 4-5. 

"The output of the video recorder is passed, via a monitor 42, to the stills 
unit 31 , This permits an image recorded by the system to be copied into 
the stills unit for future reference." 9: 22-25. 

FIG. 2 and accompanying text. 


15.11 


vary the dimensions and the rate at 
which a particular image is stored in 
accordance with one of the externally 
derived commands. 


"The video recorder may either be permanently running or operated 
under the control of the operator when an event of interest occurs," 9: 
19-21. 

"An effects unit 20 includes a buffer memory 24 and a set of 13 video 
compression units 23." Abstract. 

"in some forms of security system. ..the system will also Include a video 
image storage unit." 4: 57-59. 

"...the effects unit 20 could contain a set of 12 separate memories, one 
for each camera." 8:4-5. 
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"The output of the video recorder is passed, via a monitor 42, to the stills 
unit 31. This permits an image recorded by the system to be copied into 
the stills unit for future reference." 9: 22-25. 

FIG. 2 and accompanying text. 
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Asserted claims 


McLeod 


8.1 


B. The method of simultaneously displaying 
and storing multiple video images, 
comprising the steps of: 


"An AVS [automated video surveillance] system with multiple image 
capture and storage provides the ultimate in flexibility for time-lapse 
recording." 237. 

"The whole sequence of alarm image capture, compression, storage and 
return to monitoring must run very quickly." 236. 

"High-quality stored images of alarm events is (or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video tape recording." 236. 

"Essential features include:. ..Storage of pre- and post-alarm images." 
237. 


8.2 


receiving video images from a plurality of 


"Essential features include:. ..Multiple camera handling," 237. 

"All systems have to cope with multiple camera inputs. Most systems do 
this using some kind of video multiplexer unit between the cameras and 
the image capture software... This rather expensive way of doing things 
permits full parallel processing of the video camera channels if the 
system is equipped with multiple processors." 233. 


8.3 


digitizing one or more of the images if not 
already in digital form; 


"Essential features include:... Built-in image compression." 237. 

"When an AVS system offers the option of storing video frames from 
alarm events, these are stored in digital form and will not degrade with 
repeated overwriting or copying." 236. 

"The whole sequence of alarm image capture, compression, storage and 
return to monitoring must run very quickly." 236. 

"Alarm images may be automatically compressed before storing on hard- 
disk, so that a larqe number of imaqes can be stored." 236. 


8.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first, predetermined frame 
rate and resolution associated with each 
window; and 


"Essential features include;,, .High image quality (better than 400 x 300 
x 8 bit)." 237. 

"PC-based systems have a significant advantage in the availability of 
low-cost interface and control boards, peripheral equipment (disk drives, 
monitors, etc.) and software tools." 233. 

"All AVS systems must provide a method of defining one or more 
windows or areas of interest in an image... Multiple overlapping windows 
are essential." 233. 

"The rate of capture can be varied according to a specified schedule or 
speeded up in (he case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 

"A large proportion of these installations will therefore require automaled 
processing to reduce operating costs and increase effectiveness and 
reliability." 231. 

"Both the spatial and greyscale resolution of the captured imaqes are 
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important.. .The quality of imaging hardware is certainly controllable and 
must be of a sufficiently good standard, with the spatial resolution 
mentioned above and an 8-bit qreyscale resolution." 236. 


8.5 


simultaneously storing Ihe displayed 
images using a second, predetermined 
frame rate and resolution associated with 
each image. 


"An AVS [automated video surveillance] system with multiple image 
capture and storage provides the ultimate in flexibility for time-lapse 
recording." 237. 

"Essential features include:...High image quality (better than 400 x 300 x 
a bit}.. .Storage of pre- and post-alarm images." 237. 

"The rate of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 

"High-quality stored images of alarm events is (or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video tape recording," 23S. 

"A full image database facility with search functions is an important part 
of a comprehensive AVS-based security system." 236. 

"Both the spatial and greyscale resolution of the captured images are 
important.. .The quality of imaging hardware is certainly controllable and 
must be of a sufficiently good standard, with the spatial resolution 
mentioned above and an 8-bit greyscale resolution." 236. 

"A large proportion of these installations will therefore require automated 
processing to reduce operating costs and increase effectiveness and 
reliability." 231. 


12.1 


12. The method of simultaneously 
displaying and storing multiple video 
images, comprising the steps of: 


"An AVS system with multiple image capture and storage provides the 
ultimate in flexibility for time-lapse recording." 237. 

"The whole sequence of alarm image capture, compression, storage and 
return to monitoring must run very quickly." 236. 

"All AVS systems must provide a method of defining one or more 
windows or areas of interest in an image... Multiple overlapping windows 
are essential." 233, 

High-quality stored images of alarm events is (or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video tape recording." 236. 

"Essential features include:. ..Storage of pre- and post-alarm images," 
237. 


12.2 


receiving video images from a plurality of 
sources; 


"Essential features include:. ..Multiple camera handling." 237. 

"All systems have to cope with multiple camera inpuls. Most systems do 
this using some kind of video multiplexer unit between the cameras and 
the image capture software... This rather expensive way of doing things 
permits full parallel processing of the video camera channels if the 
system is equipped with multiple processors." 233. 
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12.3 


digitizing one or more of Ihe images if nol 
already in digital form; 


"Essentia! features include:.,, Built-in image compression." 237. 

"When an AVS system offers the option of staring video frames from 
alarm events, these are stored in digila! form and will nol degrade with 
repeated overwriting or copying." 236. 

"The whole sequence of alarm image capture, compression, storage and 
return to monitoring must run very quickly." 236, 

"Alarm images may be automatically compressed before storing on hard- 
disk, so that a larqe number of images can be stared." 236. 


12.4 


displaying at least certain of the digitized 
images in separate windows on a display 
device, using a first set of temporal and 
spatial parameters associated with each 
image in each window; 


"A large proportion of Ihese installations will therefore require automated 
processing to reduce operating costs and increase effectiveness and 
reliability." 231. 

"PC-based systems have a significant advantage in the availability of 
low-cost interface and control boards, peripheral equipment (disk drives, 
monitors, etc.) and software tools." 233. 

"The rate of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 

"All AVS systems must provide a method of defining one or more 
windows or areas of Interest in an image. ..Multiple overlapping windows 
are essential. 11 233. 

"Both the spatiai and grayscale resolution of the captured images are 
important,. .The quality of imaging hardware is certainly controllable and 
must be of a sufficiently good standard, with the spatial resolution 
mentioned above and an 8-bit qreyscale resolution." 236. 


12.5 


simultaneously storing Ihe displayed 
images using a second set of temporal and 
spatial parameters associated with each 
image. 


An AVS [automated video surveillance] system with multiple image 
capture and storage provides the ultimate in flexibility far time-lapse 
recording." 237. 

"Essential features include:... High image quality (better than 400 x 300 x 
8 bit),.. Storage of pre- and post-alarm images." 237. 

"The rale of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 

"High-quality stored images of alarm events is (or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video (ape recording." 236. 

"A full image database facility wilh search functions is an important part 
of a comprehensive AVS-based security system." 236. 

"Both the spatial and greyscale resolution of the captured images are 
important... The quality of imaqinq hardware is certainly controllable and 
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must be of a sufficiently good standard, with the spatial resolution 
mentioned above and an 8-bit greyscale resolution," 236. 

"A large proportion of these installations will therefore require automated 
processing to reduce operating costs and increase effectiveness and 
reliability." 231. 


15.1 


15, A video storage and display system, 
comprising: 


"An AVS system with multiple image capture and storage provides the 
ultimate in flexibility for time-lapse recording." 237. 

"The whole sequence of alarm image capture, compression, storage and 
return to monitoring must run very quickly." 236. 

"High-quality stored images of alarm events is (or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video tape recording." 236. 

"Essential features include:. ..Storage of pre- and post-alarm images." 
237. 


15.2 


a plurality of video cameras, each 
outputting a signal representative of a video 
image; 


"Essential features include:. ..Multiple camera handling." 237. 

"All systems have to cope with multiple camera inputs. Most systems do 
this using some kind of video multiplexer unit between the cameras and 
the image capture software... This rather expensive way of doing things 
permits full parallel processing of the video camera channels if the 
system is equipped with multiple processors." 233. 


15.3 


means to receive (he signals from each 
camera and digitally compress the images; 
and 


Means to receive the signals from each camera and digitally compress 
the images is "built-in image compression" functionality. 

"Essential features include:,., Built-in image compression." 237. 

"When an AVS system offers the option of storing video frames from 
alarm events, these are stored in digital form and will not degrade with 
repeated overwriting or copying." 236. 

"The whole sequence of alarm image capture, compression, storage and 
return to monitoring must run very quickly." 236. 

"Alarm images may be automatically compressed before storing on hard- 
disk, so that a large number of images can be stored." 236. 


15.4 


a computer configured to receive the 
digitally compressed images, the computer 
being interfaced to the following devices: 


"Today there is a definite trend towards the use of standard PC-based 
processing platforms for AVS, exploiting the wide range of software and 
hardware which is available for the PC." 230. 

"In this way, several surveillance sites can be operated via modem from 
a single remotely-located PC, with automatic call-up in the event of an 
alarm," 236. 


15.5 


a display screen, 


"AVS systems can be applied to almost any situation where CCTV 
scene." 23B. 


15.6 


means to receive externally derived 
operator commands including means for 
sensing a deviation from the normal- 
state image scene associated with at 


Means to receive externally derived operator commands is "[sample 
operator interface" functionality. 

Means for sensing a deviation from the normal-stale image scene 



4 





USP 5,625,410 


"Automated Video Surveillance - Teaching an Old Dog New Tricks" 
SPIE Vol. 1989 

Publication Date: 12/17/1993 




least one of the video cameras, the 
existence of the deviation being used as 
the basis for generating an externally 
derived command, and 


associated with at least one of the video cameras is "[ajutomatic event 
logging and alarm generation" functionality. 

"Essential features include:.. .Automatic event logging and alarm 
generation. ..Simple operator interface." 237. 

"The basic purpose of an AVS system is to detect alarm events, however 
they are defined... An alarm event must be detectable by some kind of 
change in the sequence of images captured of the scene. The event 
itself is usually an object appearing in, or disappearing from, the field of 
view or area of interest." 233. 

"The actual processing algorithms used in the more sophisticated AVS 
system to detect real events and ignore normal movement are a closely- 
guarded secret, and little published information is available, Many of 
these algorithms have been developed in military research programmes 
for target identification and target tracking." 234. 

"More generally, it can be of interest to note the behaviour of an object 
within the scene. This type of analysis notes the position of each 
change and links them to previous changes. Thus the point of entry of 
an object in the scene can be noted and/or its point of exist. In this way 
specific types of behavior can be defined as alarm situations with a high 
degree of discrimination." 234. 

"This performance trade-off can be optimised if the AVS system is 
sufficiently flexible, i.e. if the system has several methods of scene 
analysis and criteria for detecting alarm situations." 234. 


15.7 


a high-capacity storage medium, and 
programmed to perform the following 
functions: 


"Essential features include:. ..Storage of pre- and post-alarm images." 
237. 

"The rate of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 

"High-quality stored images of alarm events is (or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video tape recording." 236. 

"These [AVS] systems include storage of multiple alarm-images, remote 
control, detection of non-motion and sophisticated methods of 
compensation for environmental charges," 230. 

"A full image database facility with search functions is an important part 
of a comprehensive AVS-based security system." 236, 


15.8 


display the digitally compressed 

windows on the display screen, each 
window being associated with an 
update rate and dimensions in pixels, 


"The rate of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene," 238, 

"PC-based systems have a significant advantage in the availability of 
low-cost interface and control boards, peripheral equipment (disk drives, 
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monitors, etc.) and software tools." 233. 

"All AVS systems must provide a method of defining one or more 
windows or areas of inleresl in an image.. .Multiple overlapping windows 
are essential." 233. 


15.9 


vary the dimensions and the rate at 
which a particular image is updated in 
its window in accordance with one of 
the externally derived commands, 


"Essential features include* Simple operator interface " 237 

"The rate of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 


15.10 


store the digitally compressed images 
in the high-capacity storage medium, 
and 


"Essential features include:. ..Storage of pre- and post-alarm images." 
237. 

"The rate of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 

High-Duality stored images of alarm events is (or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video tape recording." 236. 

"A full image database facility with search functions is an important part 
of a comprehensive AVS-based security system." 236. 


15.11 


vary the dimensions and the rate at 
which a particular image is stored in 
accordance with one of the externally 
derived commands. 


"Essential features include:. ..Storage of pre- and post-alarm 
images-Simple operator interface." 237. 

"The rate of capture can be varied according to a specified schedule or 
speeded up in the case of detection of an interesting event. The rate of 
capture can be directly linked to the measured amount of activity in a 
scene." 238. 

"High-quality stored images of alarm events is {or should be) one of the 
crucial advantages which AVS systems have over standard time-lapse 
or continuous loop video tape recording." 236. 

"A full image database facility with search functions is an important part 
of a comprehensive AVS-based security system." 236. 
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